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Abstract Uncertainty relations have become the trademark of quantum theory since 
they were formulated by Bohr and Heisenberg. This review covers various general- 
izations and extensions of the uncertainty relations in quantum theory that involve 
the Renyi and the Shannon entropies. The advantages of these entropic uncertainty 
relations are pointed out and their more direct connection to the observed phenom- 
ena is emphasized. Several remaining open problems are mentioned. 



Introduction 



In recent years we have seen many applications of the Renyi and Shannon entropies 
in many fields from biology, medicine, genetics, linguistics, and economics to elec- 
trical engineering, computer science, geophysics, chemistry, and physics. In par- 
ticular, the Renyi entropy has been widely used in the study of quantum systems. 
It was used in the analysis of quantum entanglement HI |8] [19] |33] [56l, quantum 
communication protocols ll30l l49l . quantum correlations 1421, quantum measure- 
ment Is], and decoherence Bol . multiparticle production in high-energy collisions 
lfT6l[T7l[T8l . quantum statistical mechanics B4| . pattern formation 12211231 . local- 
ization properties of Rydberg states JS] and spin systems lISTl |59l , in the study of 
the quantum-classical correspondence ll24l . in electromagnetic beams 1251 . and the 
localization in phase space l52ll58l . 

Our aim in this review is to use the Shannon and Renyi entropies to describe the 
limitations on the available information that characterizes the states of quantum sys- 
tems. These limitations in the form of mathematical inequalities have the physical 
interpretation of the uncertainty relations. We will not enter here into the discussion 
(cf. I20II57I ) of a fundamental problem: which (if any) entropic measure of uncer- 
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tainty is really most adequate in the analysis of quantum mechanical measurements. 
The uncertainty relations discussed in this paper are valid as mathematical inequali- 
ties, regardless of their physical interpretation. Since this is a review, we felt free to 
use the results of our previous investigations. Of course, such self -plagiarism would 
be highly unethical in an original publication. 



1 Information entropy as a measure of uncertainty 

Statistical complexity, a tool presented and explored in this book is based on in- 
formation entropy. This concept was introduced by Claude Shannon 1551 in 1948 
and grew up to have many applications. There are also several generalizations and 
extensions which we will discuss in our contribution. We shall focus on the uncer- 
tainty, a notion closely connected with the information entropy but a little bit wider 
and having different meanings depending on a context. We shall use here the term 
uncertainty as a measure of missing information. The use of the information entropy 
as a measure of uncertainty becomes then very natural. All we have to do is to re- 
verse the sign. The lack of information — negative information — is the uncertainty. 
In simple terms, we can measure the capacity of an empty tank by measuring the 
volume of water filling this tank. Therefore, the uncertainty or missing information 
can be measured in exactly the same manner as the information is measured. We 
shall exploit this point of view showing that the measure of uncertainty based on 
the information entropy may be used to replace famous quantum mechanical uncer- 
tainty relations. Moreover, we shall argue now that this method of expressing the 
uncertainty relations is much closer to the spirit of quantum theory. 



1.1 Standard deviation 

In classical physics the positions and momenta of every particles can be determined 
without any fundamental limitations. In that case, when we talk about an uncertainty 
of position or momentum of a particle, we mean an uncertainty caused by a lack of 
precision of our measuring instruments. When we measure some observable Q we 
usually repeat this measurement many times obtaining a distribution of values. We 
apply then various standard procedures, well known to experimentalists, to extract 
the "best value" of the measured quantity. A crude, but often a sufficient procedure is 
to evaluate an average value {Q) of Q. We can also calculate the standard deviation: 



which we treat as a measure of uncertainty of {Q) . It is the uncertainty connected 
directly with a given experimental setup and has no fundamental significance. A 
more skilled experimentalist will be able to reduce this uncertainty. 




(1) 
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In quantum physics we face a dramatic change because we have to deal with a 
spread of measured values which is of fundamental nature. The uncertainty in most 
measurements (there are some exceptions) cannot be indefinitely decreased. This is 
due, at least at this stage of our theoretical understanding, to the probabilistic nature 
of the quantum world. For example, the state of a single nonrelativistic quantum 
particle can be described by a wave function \(f{r). The square of the modulus of 
this wave function p (r) = |\//(r) |" determines the probability distribution of the 
position of the particle. Since the probability to find the particle anywhere must be 
equal to 1, the function i// (r) must be normalized according to: 



/ d'r\xif{r)\'-^l. 



(2) 



This probabilistic distribution of values at our disposal is not connected with some 
faults of our measuring procedure but it is an intrinsic property — the spread of 
values of the position r cannot be avoided. The classical position can at best be 
associated with the average value 



rd = {r) = / (frrp{r). 



(3) 



Having a probability distribution p (r) we can proceed according to the rules of 
statistics and calculate the standard deviation, say cXj, that characterizes the spread 
of the values of the coordinate x. 



(y.x 



(Pr{x-{x)fp{r) 



.1/2 



(4) 



After the Fourier transformation, we can obtain another description of the same 
state 



(5) 



The Fourier transform ij/ {p) of a wave function, according to the rules of quantum 
mechanics, gives the probability distribution in momentum space p [p) = \ w{p) 
Note, that p (/>) is not the Fourier transform of p (r). Due to the Plancherel theorem 
for the Fourier transform this probability distribution is normalized since the original 
function was normalized as expressed by Eq. (|2]i. Using this probability distribution 
we can calculate Op^ the standard deviation of the px component of the momentum. 



ll/2 



d'p{p.-{p.)rp{p) 



(6) 



Even though for different states both standard deviations Ox and Gp^ can be ar- 
bitrarily small when treated separately, they become correlated when calculated for 
the same state. This correlation is usually expressed by the Heisenberg uncertainty 
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relation, 



h 

(^vCTp, >-. 



(7) 



The bound in the inequality (|7]i is saturated by Gaussian wave functions. Heisenberg 
explained this relation in the following words |'35l: 

"the more accurately the position is known, the less accurately is the momentum 
determined and vice versa'. 

Quantum mechanics gave an important reason to study the inherent incomplete- 
ness (or uncertainty) of our information about quantum objects. However, in our 
opinion, the expression of the uncertainty in terms of standard deviations is too 
much ingrained in classical physics to be of importance at a more fundamental 
level. We shall argue in the next section that the measure of uncertainty in terms 
of information entropy is much more appropriate in the quantum world. We shall 
prove the uncertainty relations in quantum mechanics expressed in terms of the in- 
formation entropy. Finally, in the last section we introduce further generalizations of 
these ideas. We begin with a critical analysis of the standard deviations as measures 
of uncertainty. 



1.2 Limitations on the use of standard deviations 

As we have already noticed, the standard deviation is a well known and widely ac- 
cepted measure of uncertainty. However it is rarely mentioned that it is not an ideal 
tool, failing even in very simple situations. The reason, why we should be care- 
ful while using the standard deviation, is explained with the help of the following 
examples ifTTl . 

1.2.1 Example I 



L(l-1/N) 



Distance NL 



L/N 



State I 



A 



B 



Fig. 1 The particle is to be found mostly in a central region. In addition, there is a tiny probability 
that the particle can be found far away. 
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Let us specify two regions on the real axis (see Fig.lTJ. The first region is the line 
segment A = [L{N+l /N) ,L{N +1)] with its length equal to L ( 1 - 1 /A^) where L 
is the unit length and is a large number. The second region B is the line segment 
with its length equal to L/N separated from the first region by the large distance NL. 
In the next step let us assume that we have the probability distribution of the form 
(the boxes in Fig. [T]represent the probability distribution); 

{1/L X G A 

1/L xgB (8) 

elsewhere 

The standard deviation of the variable x calculated in this case is: 

-n^)-L^{N-'- + l-^, (9) 

and for sufficiently large we obtain: 

C7,(I)«LVA^. (10) 

Therefore, Ox tends to infinity with N ^ °°, while common sense predicts that the 
uncertainty should remain finite. So, why the uncertainty measured by the standard 
deviation grows with A^? It is simply the effect of a growing distance between the 
two regions. Standard deviation is based on the second moment which is very sensi- 
tive to the values of an observable lying far away from the average. This is the first 
flaw of the standard deviation. Another one appears in the second example ifTDl . 



1.2.2 Example n 



State IIA 



I 


II 


III 


IV 



Fig. 2 The particle is localized with a uniformly distributed probability in a box of length L. 



IV 



State IIB 



m 



Fig. 3 The particle is localized with equal probabilities in two smaller boxes each of length L/4. 
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In the previous example the size of the space where the probability distribution 
is constant is preserved. Now we omit this condition to present, one more time, 
inadequateness of the standard deviation and prepare the reader for the solution of 
this problem. Let us assume two different cases (see Figs 2 and 3). In the case A we 
take: 

(11) 

elsewhere 
in the case B we have: 

xe[0,L/4] 

Pb(x)=<(2/L xe[3L/4,L]. (12) 

elsewhere 

It is easy to see that in the case A the size of the space where the particle can be found 
is L, while in the case B this size is L/2. In the case B we know more about position 
than in the case A. According to this obvious argument it is rather disappointing that 
the uncertainty of the position is greater in the case B, 

(Jv(IIA) = ^, (13a) 




C7,(IIB) = \/-^. (13b) 



This is another manifestation of the fact that the gap between two regions (line 
segment [L/4, 3L/4]) where the particle cannot be found contributes to the standard 
deviation. 



1.3 Uncertainty of measurements 

In all natural sciences measurements play a fundamental role. Every measurement 
has some uncertainty, so we want our theoretical tools to be directly correlated with 
our knowledge about that uncertainty. On the other hand, as it has been aptly stressed 
by Peres ll46l . "The uncertainty relation such as (JxOp > /i/2 is not a statement about 
the accuracy of our measuring instruments." The Heisenberg uncertainty relations in 
their standard form ^ completely ignore these problems. In what follows we show 
how to incorporate the quantum mechanical restrictions on the information obtained 
in an experiment. We shall consider, however, only the ideal situation when the re- 
strictions on the information gathered in the process follow from the statistical na- 
ture of quantum mechanics. Other sources of information loss will not be taken into 
account. Still, the real experimental errors will be, to some extent, represented by 
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the assumed precision of the measurements. To start, we shall rephrase our quotation 
from Heisenberg by using the notion of information: 

"the more information we have about the position, the less information we can 
acquire about the momentum and vice versa". 



1.4 Shannon entropy 

Since we know precisely how to measure information, we may try to give a rigorous 
mathematical relation that will reflect this statement. Shannon connected the mea- 
sure of the information content with a probability distribution. The use of the infor- 
mation entropy fits perfectly the statistical nature of quantum mechanical measure- 
ments. All we have to do is to insert the set of probabilities obtained from quantum 
mechanics into the famous Shannon formula for the information entropy. Consider- 
ing our mathematical applications, we shall use this formula with natural logarithms, 
not with logarithms to the base 2, 

H=-Y,Pklnpk. (14) 

k 

We shall now associate information about the experimental errors with the proba- 
bilities Pit. The proposal to associate the Shannon entropy with the partitioning of 
the spectrum of a physical observable was made by Partovi 1451 . As an illustration, 
let us consider the measurements of the position. For simplicity, we shall consider a 
one dimensional system and assume that the experimental accuracy 8x is the same 
over the whole range of measurements. In other words, we divide the whole region 
of interest into bins — equal segments of size 8x. The bin size 8x will be viewed as 
a measure of the experimental error 

Each state of a particle whose position is being measured can be associated with 
a histogram generated by a set of probabilities calculated according to the rules 
of quantum mechanics. For a pure state, described by a wave function the 
probability to find the particle in the ;-th bin is 

r{i+l/2)Sx 

qi= I dxp{x). (15) 

J(i-\l2)Sx 

The uncertainty in position for the bin size 8x is, therefore, given by the formula 

For the experimental setup characterized by the bin size 8x the uncertainty of the 
measurement is the lowest when the particle is localized in just one bin. The prob- 
ability corresponding to this bin is equal to 1 and the uncertainty is zero. In all 
other cases, we obtain some positive number — a measure of uncertainty. When the 
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number of bins is finite, say A^, the maximal value of the uncertainty is InA^ — the 
probability to find the particle in each bin is the same, equal to 

The uncertainty in momentum is described by the formula ( fT4b in which we 
substitute now the probabilities associated with momentum measurements. Since 
most of our considerations will have a purely mathematical character, from now 
on we shall replace momentum by the wave vector k ^ p/Ti. In this way we get 
rid of the Planck constant in our formulas. In physical terminology this means that 
we use the system of units in which Ti = I. According to quantum mechanics, the 
probability to find the momentum in the j-th bin is 

rij+l/2)Sk 

Pj^ / dkp{k), (17) 

Ju-imsk 

where p (k) is the modulus squared of the one-dimensional Fourier transform \fr{k) 
of the wave function, 

r ^.-'^Xx), (18) 

and 8k is the resolution of the instruments measuring the momentum in units of 
h. The uncertainty in momentum measured with the use of the Shannon formula is 
constructed in the same way as the uncertainty in position, 

H^'^ = - £ pA'^PJ- (19) 

j=-oo 



1.4.1 Examples 

The uncertainties measured with the use of the formulas (fT6] l and (fT9] l do not suffer 
from the deficiencies described by our examples I and II. One can easily check that 
in the case I the uncertainty caused by the smaller region does not contribute in the 
limit when N ^ °°. In turn, in the case II when 8x ~ L/4 the uncertainty in the 
state A is equal to 21n2 while in the state B it is equal to ln2. Thus, as expected, the 
position uncertainty in the state A is greater (we have less information) than in the 
state B. 

Now, we shall give one more very simple example that clearly shows the merits 
of entropic definition of uncertainty. Let us consider a particle in one dimension 
localized on the line segment [—a, a]. Assuming a homogeneous distribution, we 
obtain the following wave function: 

Waix)=\' , ^ ' ^ (20) 

elsewhere 



The Fourier transform of y/aix) is: 
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1 sin(flfc) 



k 



(21) 



This leads to the following probability distribution in momentum space: 



Paik) 




1 



(22) 



The standard uncertainty relation (|7]l for this state is meaningless because the sec- 
ond moment of Pa{k) is infinite. However the uncertainty in momentum measured 
with the Shannon formula is finite. Taking for simplicity the bin size in momentum 
as 8k ~ In /a, we obtain the following expression for the probability to find the 
momentum in the y-th bin; 



where Si is the integral sine function. The uncertainty in momentum is obtained 
by evaluating numerically the sum (dll) which gives = 0.530. To obtain the 
position uncertainty, we take just two bins (dx = a), so that //'^' = ln2. The sum of 
these two uncertainties is about 1.223. 



1.5 Entropic uncertainty relations 

We have shown that the use of the Shannon formula gives a very sensible measure 
of uncertainties that takes into account the resolution of measuring devices. The sit- 
uation becomes even more interesting when we consider measurements on the same 
quantum state of two "incompatible" properties of a particle. The term incompat- 
ible has a precise meaning in terms of the experimental setup and is reflected in 
the mathematical framework of quantum mechanics. In this study, we shall treat not 
only the most important example of such incompatible properties — the position 
and the momentum of a particle — but also angle and angular momentum. 

As has been argued by Bohr and Heisenberg ||36l , it is impossible to measure 
the position without loosing information about the momentum and vice versa. This 
property is embodied in the standard Heisenberg uncertainty relation and we will 
express it now in terms of Shannon measures of uncertainty. 




Si[i4j + 2)n] Si[(4;-2)7r] 



(23) 



n 



K 
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> 1 - ln2-ln 



( 



5x8p 



h 



) 



(24) 



To stress the physical meaning of this relation, we reinserted the Planck constant. It 
is clear that this inequality is not sharp since for large 8x8 p the right hand side be- 
comes negative. However, in the quantum regime, when the volume of phase space 
8x8 p does not exceed the Planck constant we obtain a meaningful limitation on 
the sum of the uncertainties in position and in momentum. When one uncertainty 
tends to zero, the other must stay above the limit. In the last example considered in 
the previous section the right hand side in (l24l) is equal to 1 — ln2 = 0.307, while 
the calculated value of the sum of two uncertainties was equal 1.223. 

The proof of this inequality was given in fJI and it proceeds as follows. First, 
we use the integral form of the Jensen inequality for convex functions ll34l |39l . The 
function p In p is a convex function. Therefore, the value of a function evaluated 
at the mean argument cannot exceed the mean value of the function so that the 
following inequality must hold: 



or after some straightforward rearrangements and with the use of Eq. ( fTSl l 

r(i+\l2)Sx 

—qilnqi>— dxp(x)ln[p{x)8x]. (27) 

J(i-l/2)Sx 

This form of the inequality is more satisfactory from the physical point of view since 
p {x) has the dimension of inverse length and the dimensional quantities should not 
appear under the logarithm. Adding the contributions from all the bins, we obtain: 



(plnp)>(p)ln(p). 



(25) 



Upon substituting here the probability distribution, we obtain: 





(26) 




(28) 



Applying the same reasoning to the momentum distribution, we arrive at: 




(29) 



Adding these two inequalities, we get on the left hand side the sum of the uncertain- 
ties in position and in momentum as in ( |24] |. What remains is to establish a bound 
on the sum of the integrals appearing on the right hand side. This problem has a long 
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history. More than half a century ago a bound has been conjectured by Hirschman 
||37l and Everett ||28ll29l . Actually, Hirschman proved only a weaker form of the in- 
equality and Everett showed that the left hand side in ( |24] | is stationary for Gaussian 
wave functions. The inequality was later proved by Bialynicki-Birula and Myciel- 
ski lfT4l and independently by Beckner ||6|. In this way we arrive at the entropic 
uncertainty relation (l24l i. We shall give a detailed derivation of this inequality and 
its extensions in the next section. 

The measure of uncertainties with the use of standard deviations requires a cer- 
tain measure of the distance between events. Sometimes there is no sensible defini- 
tion of a distance. The simplest example is the original application of the Shannon 
information entropy to text messages. The value of H can be calculated for each 
text but there is no sensible measure of a distance between the letters in the alpha- 
bet. Important examples are also found in physics. The simplest case is a quantum 
particle moving on a circle. The configuration space is labeled by the angle <p and 
the canonically conjugate variable is the angular momentum represented in quantum 
mechanics by the operator M ~ —iTid/d(p. Wave functions describing this system 
are integrable periodic functions \lf{(p) or alternatively the coefficients c,„ in the 
Fourier expansion of yf{(p). 



Even though formally (p and M obey canonical commutation relations, these rela- 
tions are not mathematically consistent because (p cannot be treated as an operator 
— multiplication by (p produces a function that is not periodic. Therefore, the notion 
of a standard deviation of (p can only be used approximately for states for which A (p 
is very small. Several, more or less natural methods, were introduced to deal with 
this problem. One of them is to use periodic functions of (p instead of the angle it- 
self (cf. 1481 for a list of references). This leads to some uncertainty relations which 
are mathematically correct but physically less transparent. The use of entropic mea- 
sures of uncertainties solves this problem. The uncertainty in position on the circle 
is defined as for position on an infinite line, except that now there is finite number 
of bins = 2n/S(p. Thus, the Shannon entropy of the angle is: 



V2k 



1 




(30) 



N-l 



(31) 



n=0 



where 




(32) 



According to the rules of quantum mechanics, the probability to find the value hm 
of angular momentum is p,„ = |c„, |^. Therefore, the Shannon entropy for the angular 
momentum is; 
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Hi^)=- £ p,n\np,n. (33) 

m=— CO 

The proof of the uncertainty relation for the angle and angular momentum entropies 
is much simpler than for the position and momentum. It will be given later in the 
more general case of the Renyi entropies. The uncertainty relation has the following 
form: 

7/(9)+HW>_ln^, (34) 
2n 

or 

//W+//(^)>lnA?. (35) 

This inequality is saturated for every eigenstate of angular momentum. Then, the 
uncertainty in angular momentum vanishes and the uncertainty in position is exactly 
InA^ because the probability to find the particle in a given bin is 



2 Renyi entropy 

The Shannon information entropy has been generalized by Renyi t501 . The Renyi 
entropy is a one-parameter family of entropic measures that share with the Shannon 
entropy several important properties. Even though the Renyi entropy was introduced 
in 1960, its substantial use in physics is more recent — it took place during the last 
decade (cf. references listed in the Introduction). 

Renyi entropy Ha is defined by the following formula: 



1 - a 



Erf 



(36) 



where pi^ is a set of probabiUties and a is a positive number. Renyi in 11501 restricted 
a to positive values but we may consider, in principle, all values. Sometimes it is 
useful to consider only the values a > 1 since we may then introduce a conjugate 
positive parameter /3 satisfying the relation 

In the limit, when a ^ 1, the Renyi entropy becomes the Shannon entropy. To see 
this, we have to apply the L'Hopital rule to the definition ( |36] | at the singular point 
a = 1. Since the Shannon entropy is a special case of the Renyi entropy, we shall 
proceed, whenever possible, with proving various properties of the Renyi entropy, 
taking at the end the limit a ^ 1. This approach is particularly fruitful in the case of 
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entropic uncertainty relations because the proofs are in a way more natural for the 
Renyi entropies than for the Shannon entropies. 

Shannon entropy can be defined as a function H{pk) of the set of probabilities, 
obeying the following axioms: 

1. H{pi,p2, ...,/:>„) is a symmetric function of its variables for « = 2,3, . . . 

2. H{p,l — p) is a continuous function of p for < p < 1 

3. Hltpu{l-t)puP2,---,Pn)=H{pup2,...,p„)+piH{t,l-t)foT 0<f < 1 

We presented the axioms in the form taken from Renyi fSOl which we liked more 
than the original axioms given by Shannon |55|. Sometimes an additional axiom is 
added to fix the scale (the base of the logarithm) of the function H. For example by 
requiring that H{1 /2, 1 /2) = 1 we obtain the entropy measured in bits (logarithm to 
the base 2). 




Fig. 4 Probability trees representing tlie main idea of tlie tliird axiom 



The first two axioms are of a simple mathematical nature but the third axiom is 
of crucial importance. This axiom may be figuratively expressed as the invariance 
of the entropy with respect to breaking down the probability tree. This invariance 
rule is illustrated in Fig. |4] It leads, in particular, to the very important property 
that characterizes the physical entropy. The entropy is an extensive quantity — for 
a composed system it must satisfy the additivity law. This law in terms of probabil- 
ities can be expressed as follows. Given two independent probability distributions 
{pi,P2, ■ ■ -TPn) and {qi,q2, ■ ■ -^qm), the entropy of the composed system must be 
equal to the sum of the entropies for the subsystems, 

H{piqi,Piq2,---,Piqm,P2qu---,P2qm,---,Pnqu---,Pnqm) 

= H{pi,p2,...,p„)+H{qi,q2,...,qm)- (38) 

It turns out that by replacing the third axiom by the additivity law we substantially 
increase the set of allowed functions. The most prominent of these generalized en- 
tropies is the Renyi entropy. It is simple task to check that the Renyi entropy obeys 
the additivity law. Indeed, from the distributive property of the logarithm we obtain 
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1-a 



■In 



1 -a 



k 



1 

1 



-In 



1 -a 



■In 



(39) 



Note that any linear combination (discrete or continuous) of Renyi entropies with 
different values of a would obey the same additivity law. For example, we may take 
a sum of two terms 



1 



■In 



a 



Ic 



1 



1-^ 



In 



(40) 



A particular expression of this type was introduced in ifTOl and is very useful in 
the context of entropic uncertainty relation. It is obtained by requiring that the two 
parameters a and j3 are constrained by the relation dJTb . In this case, they can be 
expressed in terms of a single variable; a = 1/(1 — s), j3 = 1/(1 +s). The new 
symmetrized entropy J^/fs is a one parameter average of two Renyi entropies. 



1/(1-*) 



j(l + >n 



.Pk 



1/(1+.- 



(41) 



Since Jff^ is a symmetric function of s, it is sufficient to consider only the positive 
values < s < I. The Shannon entropy is recovered in the limit when s 0. 

The Renyi entropy is a decreasing function of a. For a given set of probabilities 
it attains its maximal value at a = 0. The symmetrized Renyi entropy attains its 
maximal value at i = 0. Starting from this value, as a symmetric function of s, it 
drops down in both directions. 



2.1 Renyi entropy and the uncertainty relations 

Our goal is now to generalize the uncertainty relations to the Renyi entropies. In 
this section we shall consider only the measurements of position and momentum. 
We have already defined the Shannon information entropies that contain information 
about the precision of measurements. The definitions of the uncertainty in position 
and momentum, as measured by the Renyi entropy, are obvious; 



1-a 



In 



Lp^ 



(42) 
(43) 
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where the probabilities qi and pj are given by the formulas ( fTSl ) and ( fTTj ). The rea- 
son, why we have chosen the Renyi entropies with different parameters will be- 
come clear later. For definiteness, we shall assume at this point that a > j3 (later 
this restriction will be lifted). This means that according to ( |37] ) 1 < a < 0° and 
1/2 < j3 < 1. Therefore, z" is a convex function, while is concave. These prop- 
erties enable us to use the Jensen inequality in the same way as we did before, and 
arrive at: 

/ , r(i+l/2)Sx \" , r(i+\l2)5x 

N- / dxp{x)\ <— <ix[p(x)]", (44a) 

\OX J (i^\l2)Sx J J(i-l/2)5x 

1 pU+imSk ( ^ r(j+\l2)5k \P 

J- / dk[p{k)f<{ — / dkp{k)] . (44b) 

Summing ( |44at and ( |44bt over the indices ; and j we obtain: 

{5xy-" qf < f dx[pix)f , (45a) 

/ dk[p{k)f<{5ky-P f pJ. (45b) 

JS. j=-oo 

At this point we invoke a powerful Babenko-Beckner inequality for {p,q) norms of 
a function and its Fourier transform. This inequality was proved for restricted values 
of a and j3 by Babenko 2) and for all values by Beckner Q. In our notation, this 
inequality reads: 



where 




This inequality enables us to put together the formulas ( 145 a| ) and ( |45b| i. To this end, 
we raise to the power 1/a both sides of ( 145 ab . Next, we raise to the power of 1 /j3 
both sides of ( I45bl i and multiply the resulting inequaUty by « (a,j3). In this way we 
can obtain the following chain of inequalities: 

(Sx)'-" t qf 

i=—co 

<n{a,l5)(^l^dk[pik)f^ <n{a^P) 



(^l^dxipixry 



1-p 



J=- 



(48) 
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Now, we take only the first and the last term of this chain and multiply both sides of 
the resulting inequality by (a/7r)'/^" to obtain: 



l-a 



l/a 



< 




(49) 



Next, we evaluate the logarithms of both sides and multiply the result by a positive 
number a/(a — 1). After a rearrangement of terms, with the use of the relationship 
dJTl ). we arrive at the final form of the uncertainty relation (with Planck's constant 
reinserted) between position and momentum in terms of the Renyi entropies ifTOl : 



Ha +Hp >--^^ + ^ 



-ln2-ln 



5x5 p 



(50) 



We can lift now the restriction that a> ji. Owing to a symmetry between a function 
and its Fourier transform we can write the same inequality dSOl l but with x and 
p interchanged. After all, it does not make any difference from the mathematical 
point of view, what is called x and what is called p, as long as the corresponding 
wave functions are connected by the Fourier transformation. Therefore, we can take 
the average of ( fSOl l and its counterpart with x and p interchanged and obtain the 
following uncertainty relation for symmetrized entropies: 



ln2-ln 



5x5 p 



(51) 



This relation is more satisfactory than dSOl l because the uncertainties of both quan- 
tities X and p are measured in the same way. In the limit, when i — we obtain 
the uncertainty relation ( |24] | for the Shannon entropies. The inequality ( BTl i (or its 
asymmetric counterpart dSOl l) is the best known uncertainty relation for the entropies 
that takes into account finite resolution of measurements. However, this inequality 
is obviously not a sharp one. For 5x5 p/h only slightly larger than 1 the right hand 
side of dSOl l becomes negative while the left hand side is by definition positive. For 
finite values of 5x5p/h there must exist a better lower bound. Since the Babenko- 
Beckner inequality ( l46b cannot be improved (it is saturated by Gaussian functions), 
we conclude that Jensen inequalities ( I44al I44bl i used together are not optimal. Of 
course, each of them can be separately saturated but when they are used jointly one 
should somewhere include the information about the Fourier relationship between 
the functions. An improvement of the uncertainty relations ( |50l l or ( fSH i is highly 
desired but it does not seem to be easy. A recent attempt IMl failed completely (see 

ma). 
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3 Uncertainty relations: from discrete to continuous 



In this section we describe various types of uncertainty relations that depart from the 
original Heisenberg relations for position and momentum much further than those 
described so far We shall also comment on different mathematical tools that are 
used in proving these relations. 



3.1 The uncertainty relations for N-level systems 

Pure states of an A^-level system are described in quantum mechanics by normalized 
vectors in the A^-dimensional Hilbert space J^ffj. We shall use the Dirac notation 
denoting vectors by | i/a) and their scalar products by |i//2). In this notation, the 
normalization condition reads {xj/lv) = 1- Let us choose two orthonormal bases 
{ } and {\bj) } , where ij = I,. . . ,N. We can then represent each vector | Xj/) in 
two ways: 

\w) = ti^mad = t(H¥)\bj)- (52) 

'=1 7=1 

The squares of the absolute values of the complex expansion coefficients are inter- 
preted in quantum mechanics as the probabilities, say qi and pj, to find the states 
represented by the vectors and \bj), when the system is in the state \ y/), 

qi=\{a,\xif)\\ pj^\{bj\xif)\\ (53) 

The normalization of vectors and the orthonormaUty of the bases guarantees that the 
probabilities qi and pj sum up to 1 . 

3.1.1 Deutsch inequality 

Having at our disposal two sets of probabilities {qi} and {pj} we can construct two 
Shannon entropies: 

^^"^ = -L?<ln^,', = p,lnp,-. (54) 

'=1 7=1 

Since we aim at finding some uncertainty relation we consider the sum of these 
entropies: 

= (55) 

i=l7=l 
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where 

Qij = - In ( (fl, I r> ( r - In ( (fe; I r> ( r I ^O) ■ (56) 

In 1983 Deutsch 1261 found a lower bound on the sum ( |55] |. He observed that for a 
normaUzed vector each Qij is nonnegative. Therefore, by finding the minimal 
value of all 2,/s we determine a lower bound on the sum (l55l l. We shall present 
here an expanded version of the Deutsch analysis. For each pair the minimal 
value of Qij is attained for some function ^ij. This function is found by varying Qij 
with respect to the wave function \// with the normalization constraint (v^|v) = 1- 

'Q,j+K{^lfij\^lfij)]=Q, (57) 



where fc is a Lagrange multiplier. In this way we arrive at the equation for the vector 
\Wij)- 

Taking the scalar product of this equation with we obtain from the normal- 

ization condition that K" = 2. To find the solution of ( |58] | we multiply this equation 
by the adjoined vectors (fl,| and {bj\. In this way we obtain the following algebraic 
equations for two complex variables a — {xj/ijloi) and b = {\ifij\bj) with one fixed 
complex parameter {ai\bj). 

N^4 + ^, + (59) 

The last term in each equation must be real since the rest is real. Next, we divide both 
sides of the first equation by those of the second. After some simple rearrangements, 
we arrive at: 

= (60) 

Since both terms on the right hand side are real, they cancel out and we obtain 
|a| = \b\. Inserting this into any of the two equations (|59] l, we obtain 

\a\' = \[\±\{ai\bj)\]. (61) 

The choice of the minus sign gives the maximal value of Qij but only in the subspace 
spanned by the vectors ja,) and \bj). Choosing the plus sign, we obtain 

I V/,7) = ,,,rM/'^|^,|, +exp(-/arg(fl,|^,)) \bj)] , (62) 
^2{\ + \{ai\bj)\) 
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where exp(i0) is an arbitrary phase factor. We can insert this solution into {55[ . and 
using the fact that this solution is minimizer, we obtain the inequality: 



'■=17=1 



(63) 



This inequality will still hold if we replace each modulus |(fl, |foj)| by the maximal 
value Cb, 



Cb ^sup\{ai\bj) 
ihJ) 



(64) 



After this replacement, we can do summations over / and j and arrive at the Deutsch 
result I 



i/W+//W>-21n 



(65) 



3.1.2 Maassen-Uffink inequalities 

Even though the bound in the Deutsch uncertainty relation is saturated when the 
two bases have common vectors, there is room for improvement. Of course, the im- 
proved inequality must coincide with i65[ when it is saturated. An improved relation 
was conjectured by Kraus BTl and it has the form: 

//(«)+//(*)> _21nCB, (66) 

This inequality was later proved by Maassen and Uffink B3ll . We shall present a 
different version of the proof based on the Renyi entropy. The mathematical tools 
needed to prove the inequality ( |66] | are the same as those used for the entropies 
with continuous variables. At the bottom of every uncertainty relation there is some 
mathematical theorem. In the case of the Maassen-Uffink relation this role is played 
by the Riesz theorem ll47l ISTI which says that for every A^-dimensional complex 
vector X and a unitary transformation matrix T with coefficients tji, the following 
inequality between the norms is valid: 

c^/l'WXlf <c^^''\\tX\\\ (67) 

where the constant c = sup^, \ tji | and the coefficients jx and V obey the relation 

- + - = 1, l<v<2. (68) 
II V 

The norms are defined as usual, 
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1^11'' = 



k 
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(69) 



but we do not use the traditional symbols {p,q) for the norms since this would 
interfere with our usage of p and q to denote the probabilities. 
To prove the inequality ( |66] | we shall take x, = {ai\w) ™d 



^From the resolution of the identity (a, | = 1), we obtain: 

N N 



(70) 



(71) 



(=1 



i=l 



Using the definitions (|53] |. we can rewrite the inequality (l67l i in the form; 



M/2 



1/M 



<cl/v 



Lv/2 
Pi 

1=1 



1/v 



where 



c = sup|f,7| ^ SUp|(fl,-|/7y)| =Cb. 



(72) 



(73) 



The parameters pL and v differ by a factor of 2 from the parameters a and j3 appear- 
ing in ( IJTI i. 



li = 2a, v = 2j3. 



(74) 



Next, we take the logarithm of both sides of the inequality ( |72] | and with the use of 
Eqs. ( l74b . we arrive at the uncertainty relation for the Renyi entropies: 



//i"' -2 InCfi. 



(75) 



When two observables associated with the two bases have a common vector then 
Cb = 1 and the right hand side in the last inequaUty vanishes. Thus, this uncertainty 
relation becomes empty. In the limit a 1, j3 1 this inequaUty reduces to the 
Maassen-Uffink result i 



3.1.3 Discrete Fourier transform 

In previous subsections we dealt with two orthonormal vector bases and 
{1^7,,,)}. We can expand every vector of the first basis in the second basis. 
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= L f, 7 (76) 

7=1 

where tji are the coefficients of the unitaiy transformation ( fTOl i. and for each 

N 

1 ^ {a,\a,) = £ |0,f < A? sup \tj,\^ < NCl ill) 
;=l (;■) 

It follows from this inequality that Cg > l/y/N. There are bases, called mutually 
unbiased bases, for which the sum dTSl l not only has the lowest possible value but 
the moduli of the matrix elements are all the same, 

\{ai\bj)\ = ^. (78) 



One can check by a direct calculation that for the observables associated with two 
mutually unbiased bases, for every state represented by a basis vector, either ja,) or 
\bj), the sum of the Renyi entropies saturates the lower bound, 

H'^a^ +H^^^ =\nN. (79) 

Mutually unbiased bases were introduced by Schwinger 1541 . More recently they 
were studied in more detail fT\ and were shown to be useful in the description of 
entanglement and other fundamental properties of quantum systems. In the fourth 
chapter we shall say more about the mutually unbiased bases. The most important 
example of mutually unbiased bases is present in the discrete Fourier transforma- 
tion. In this case, the two bases are related by the unitary transformation with the 
coefficients: 



r 1 

fki = exp 



iTtikl 
N 



(80) 



which satisfy the conditions jTSl l. 

The physical interpretation of the inequality ( |79] l is similar to the Heisenberg 
uncertainty relation. Two observables A and B, characterized by the bases \ai) and 
\bj) cannot have simultaneously sharp values since they do not have common ba- 
sis vectors. Moreover, every state described by a basis vector has the sum of the 
uncertainties equal to the same value 1 / \/N. The observables A and B are finite- 
dimensional analogs of canonically conjugate physical quantities. 



3.2 Shannon and Renyi entropies for continuous distributions 



In a rather crude manner we can say that the entropies for continuous distributions 
of probability are obtained by replacing the sums in the expressions ( fT4l i and ( l36b by 
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the integrals. We have already encountered such expressions, (Eqs. ( [28T l and (|29Tl), 
in our discussion of the Shannon entropies for position and momentum. Naively, we 
would like to define the Shannon entropy for a continuous probability distribution 
p{X) in the form; 

H^^'>= - J dXp{X)\np{X), (81) 

where X is some random variable. However, in most cases we encounter a problem 
since X is a dimensional quantity and the result will depend on the unit that is used 
to measure X. In order to obtain a correct formula, let us start with the original 
Shannon definition for a discrete set of probabilities ( fT4l i. Next, we insert in this 
formula the discrete probabilities pk derived from some continuous distribution. For 
example, let us choose the distribution function for position p{x). If p{x) does not 
change appreciably over the distance 5x, the Shannon entropy defined by Eqs. (fTsT i 
and (O can be approximated by, 

£ 8xp{xk)ln[p{xk)5x], (82) 

k=-oo 

where xi^ = kSx. 

We can write the right hand side as a sum of two terms 

5x 

- 5.'cp(xi,)ln[p(x^)L]-ln — , (83) 

where L is some fixed unit of length. The first term is a Riemann sum and in the 
limit, when 5x 0, it tends to the following integral: 

5 W = - / <ix p (x) In [p (x)L] . (84) 

This integral may be called the entropy of the continuous distribution p (jr) or the 
continuous entropy. 

The second term — ln(5jic/L) measures the difference between //W and S'^^^ . This 
difference must tend to oo because the information measured by //'^^ grows indefi- 
nitely when 5x — > 0, while 5'''^' remains finite. 

The same reasoning leads to the following definition of the Renyi entropy for a 
continuous distribution 

5!^' = T^ln { [ dx[pix)fL"-') . (85) 

The difference between the Renyi entropies and Sa does not depend on a and 
is, therefore, the same as for the Shannon entropies. 
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3.3 Uncertainty relations for continuous entropies 



We can formulate now uncertainty relations in terms of the Renyi and Shannon 
entropies for continuous variables, although the operational meaning of these re- 
lations is not as clear as for discrete bins. In the proof we shall make use of the 
Babenko-Beckner inequality ( l46l l. This inequality may, at first, seem to violate the 
requirement that it should be invariant under a change of the physical units used 
to measure the probability distributions p{x) and p{k). However, it turns out that 
this inequality is dimensionally correct. To see this, let us assume that we measure 
position using the unit L. It follows from the definition of the Fourier transform ( fTSl l 
that to keep this relation invariant, we have to choose 1/L as the unit of k. Now, 
we multiply the left hand side of ( |46] | by 1 written in the form After 
distributing the powers of L, we arrive at the inequality 

(^j dx[p{x)L]"/l)j' <n{a,j3)(^J dk[p{k)/LfL^ ^ . (86) 

This inequality is not only explicitly dimensionally correct but it also shows its 
invariance under a change of the unit. Taking the logarithm of both sides of this 
inequality and using the relation ( |37] |. we arrive at the uncertainty relation for the 
continuous Renyi entropies, 

>-if^ln^ + -^ln^). (87) 



Due to the relation 



a 



l-a 1 



= 0, (88) 



the uncertainty relation is invariant under a rescaling of the wave function. In the 
limit, when both a and j3 tend to 1, we obtain the uncertainty relation for the Shan- 
non entropies proved in 1 14J and in 16J, 

5W+5(*' = - / dxp{x)lnp{x) - [ dkp{k)]np{k) > l+lnn. (89) 

Js. Jr 

In evaluating this limit by the L' Hospital rule we assumed that the wave function is 
normalized, 

( dx\w{x)\^ = l. (90) 



After an arbitrary rescaUng of the wave function, the uncertainty relation takes on 
the form: 
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5W^5(A) = _ dxp(x)lnp{x)- dkp{k)lnp{k)>N^{l+lnn-4-lnN), 

(91) 

where is the norm of the wave function. We dropped in ( [89] l the scale factor L 
because the sum of the two integrals is invariant under a change of units. 



3.3.1 Gaussian wave functions 

Gaussian wave functions play a distinguished role in uncertainty relations. They sat- 
urate the standard uncertainty relations expressed in terms of standard deviations. 
They also saturate the uncertainty relations dSTl i expressed in terms of the Renyi en- 
tropies for continuous variables. Thus, unlike their discrete counterparts ( l24l i or dSOl ), 
the continuous uncertainty relations are sharp. Gaussians provide also a direct link 
between the Shannon entropies for continuous variables and the uncertainties mea- 
sured by the standard deviation. Namely, the Gaussian distribution function gives 
the maximal value of the Shannon entropy subjected to the conditions of normaliza- 
tion and a given value (7, of the standard deviation. To prove this property we shall 
search for the maximum of the functional: 

/ dx [-P (x) Inp (x) + Xx^p (x) + HP (x)] , (92) 

JR 

where A and ji are two Lagrange multipliers introduced to satisfy the constraints: 

/ dxp{x) = l, (93a) 
/ dxx^p{x) = a^. (93b) 

jR 

Varying the functional (|92] i with respect to p [x) we obtain the expression: 

-1 -lnp(x)+Ax2 + jU. (94) 

^From the requirement that this expression vanishes, we obtain a Gaussian distri- 
bution. Finally, we determine the Lagrange multipliers A and /i by imposing the 
constraints (|93] ), and we obtain: 

p{x)^^^e-i^l^-'). (95) 



This extremum is a true maximum since the entropy is a strictly concave functional 

ofp(x) m. 
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In this chapter we present a generalization of the entropic uncertainty relations to 
cover mixed states and an extension of these relations to angular variables. We shall 
also introduce uncertainty relations in phase space. Next, we return to the prob- 
lem of mutually unbiased bases, mentioned akeady in ( 13.1.31 ). Finally, we show a 
connection between the entropic uncertainty relations and the logarithmic Sobolev 
inequalities. Other extensions of mathematical nature of the entropic uncertainty 
relations were recently published by Zozor et. al. 163)1 . 



4.1 Uncertainty relations for mixed states 

Let us take a set of normalized wave functions '^fi{x) that determine the probability 
distributions p, (x). Using these distributions we may define the probability distribu- 
tion for a mixed state; 

The sum may be finite or infinite. Alternatively, we may start from the density oper- 
ator p and define the probability density as the diagonal matrix element p^ix {x) = 
(x|p|x). The positive coefficient A, determines the probability with which the state 
described by '^fi{x) enters the mixture. The normalization condition Tr{p} = 1, or 
the basic property of probabilities, require that 

L^' = l- (97) 

For each \l>i{x) we may introduce its Fourier transform V/,(A:) and then define the 
probability distribution Pi{k) in momentum space. 

PmixW-LMW, (98) 

This function can also be viewed as the momentum representation of the density 
operator, Pniix(^) = (^|p|^>- 

We begin with the following sum of Babenko-Beckner inequalities (|46] | with 
wave functions \lfi{x) and and with some weights A,-: 

(^j^dxMxT^ < „ (a,j3)X:A, (^j^dk \p,{k)f^ ■ (99) 

To find the uncertainty relation for the mixed state we shall use now the Minkowski 
inequality 1341 as was done in |lOl. For a > 1 and for an arbitrary set of nonnegative 
functions fi{x) the Minkowski inequality reads: 
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Since for a > 1 we have j3 < 1, the Minkowski inequality gets inverted. Choosing 
another set of nonnegative functions giik) we obtain; 



1//3 



< 



dk 



(101) 



Substituting now = A,p,(.)c) in (1 100b and gi{k) = XiPi{k) in ( IIOII ) we obtain two 
inequalities involving the densities for mixed states: 



/ ^x|p^i,(x)ry^"<^A,Y/" dx\pi{xT 

JR J i \Jr 



and 



Y^Xi(^j^dk\m\^y^ < (^l^dk\p^Uk)\''y' ■ (103) 

Putting together the inequalities ( |99] l. (I102l i. and (1103b we obtain the generahzation 
of the Babenko-Beckner inequality for mixed states: 



1/a 



(102) 



dx [Pmix W]") <n{a,l5)(^J^dk[p^i,{k)f^ 



1/13 



(104) 



^From this inequality we can prove the uncertainty relations dSOl l and ( BTI) for mixed 
states in the same manner as we have done it for pure states. 



4.2 Uncertainty relations for angles and angular momenta 

In ( 11.51 ) we gave the uncertainty relation for angle (p and angular momentum M in 
terms of the Shannon entropy. Now we are going to prove this relation in a more 
general case of the Renyi entropy. To this end we shall repeat and extend the previ- 
ous definitions. 



4.2.1 The uncertainty relation for a particle on a circle 

We have discussed this problem already in Sec. 11.51 and now we shall provide the 
proofs of the uncertainty relations. The proof of the uncertainty relation ( l34l i in the 
general case of the Renyi entropy will be given in two steps. 
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First, we quote the Young-Hausdorff inequality for the Fourier series IfTOl : 

in N l/« / oo \ 

d^Wm''''] < (27r)'/4«-V4M J2 k„,|2M . (105) 

The coefficients a and j3 fulfill the standard relations ( |37l ). Upon comparing the left 
hand side in (11051 ) with the definition ( l32b . we see that we can use again the Jensen 
inequality for convex functions to obtain: 

/ r(n+\)S(p \" r(n+\)S<f> 

5(pi-v = 5(p'-« / d<pw{<p)n < d(p\wm'"- (106) 

\JnS<p J Jnd(p 

Next, we do summation over n: 

d(p'-"''fq^< Tdcplxificp)]^". (107) 

,1=0 JO 

Putting the inequalities ( |105t and jlOlj together, we find: 

(5(p)'/«-'f E?«j <(2;r)i/4«-V4P( ^ |c„,|2M . (108) 

This inequality will lead us directly to the final form of the uncertainty relation for 
the Renyi entropy. To this end let us define the Renyi entropy for angle and angular 
momentum in a following form: 



(,p) _ 1 , 
//„ _^ln 



N-l 
11=0 



(109) 



H 



(M) 



In 



(110) 



where p„, = |c,„| . Taking the logarithm of both sides of dlOSI ), multiplying by 
/3/(l — j3), and identifying the Renyi entropies ( 11091 ) and ( II 10b . we obtain final 
inequahty: 



//i^'+<'>-lng=lnA^. 



(Ill) 



As in the case of Maassen-Uffink result (79[ . the right hand side of the inequality 
dl 1 11 1 is independent on the parameters a and j3 . 

This uncertainty relation can be also applied to a different physical situation. Let 
us consider the state vectors of a harmonic oscillator expanded in the Fock basis. 
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n=0 

Every such state can be described by a function of (p defined by lfT2l : 

vA((p) = £ c„e""r (113) 

,1=0 

The only difference between this wave function and the wave function for a particle 
on a circle is the restriction to nonnegative values of n. Therefore, the inequalities 
([35] l and (II 1 lb still hold but they have now a different physical interpretation. The 
value of « determines the amplitude and the angle (p is the phase of the harmonic os- 
cillation. This interpretation is useful in quantum electrodynamics where n becomes 
the number of photons in a given mode and (p is the phase of the electromagnetic 
field. 



4.2.2 The uncertainty relation for a particle on the surface of a sphere 

The uncertainty relation (111 lb may be called "the uncertainty relation on a circle", 
because the variable (p varies from to 2n. We may ask, whether there is an un- 
certainty relation for a particle on the surface of a sphere. The answer is positive 
ifTSll and to find the uncertainty relation we shall parameterize this surface by the 
azimuthal angle (p e [0,2;r] and the polar angle 9 e [0, n]. The wave functions on a 
sphere \i/{9,(p) can be expanded into spherical harmonics: 

xf,{9,(p)^-=Y, E ci,nYr{e,(p). (114) 

This expansion gives us a set of probabilities |c;,„|^ which can be used to construct 
the Renyi entropy for the square of the angular momentum, determined by I, and for 
the projection of the angular momentum on the z axis, determined by m. As in the 
case of a particle moving on a circle the two characteristics of the state — angular 
position and angular momentum — are complementary. 

There is one mathematical property of spherical harmonics that will help us to 
derive the uncertainty relation. Namely, when m = I then for large / the function F/" 
is to a very good approximation localized in the neighborhood of the equator where 
9 = 7z/2. In other words, if we divide the 9 range into equal parts with length 59 
then for every £ we can find sufficiently large / such that the following relation holds 
(the modulus of the spherical harmonic does not depend on (p): 



rn 1 1+56/2 

I d9\Yl{9,(p)\' = l-e. 

K/2-Se/2 



(115) 
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This property follows from the fact that |y/(0,(p)|^ = N\sm9\^' . Of course, the 
smaller is the value of 50, the larger / is required to localize the wave function. 

To define the Renyi entropies in the standard way we need the probability distri- 
butions in angular momentum pi„, = |c/,„p and in the position on the sphere 

^(,+1)59 fU+l)S<P 

qij= dGsinO d(p \\(fie ,(p)\^ . (116) 

JiS6 JjS<p 

^From the argument about localizability of the wave function near the equatorial 
plane we deduce that for a fixed (sufficiently large) value of I we can have the lo- 
calization in one bin in the variable 6. Therefore, I and 9 can be eliminated and we 
are left with the uncertainty relation in the projection of the angular momentum on 
the z axis and the azimuthal angle (p. The uncertainty relation in these variables has 
already been established and it will have the same form dll lb for the sphere. A com- 
plete proof of this fact is a bit more subtle and can be found in ifTSl . The introduction 
of a preferred direction associated with the projection of the angular momentum is 
rather artificial and it would be interesting to find a rotationally invariant form of the 
uncertainty relation. It would also be of interest to find generalizations of the un- 
certainty relation ( 111 lb to more dimensions and to functions defined on manifolds 
different from the surface of a sphere. 



4.3 Uncertainty relations in phase space 

The next topic in this review is a "phase-space approach" to the uncertainty rela- 
tions. We shall rewrite the sum of the Shannon entropies for position and momen- 
tum in a more symmetric way and we shall extend this symmetric description to the 
mixed states. 

To this end we rewrite the sum of the expressions ( fTSI l and ( fT9] l for the Shannon 
entropies in the following, compact form: 

hW+//W = _ £ £ /,, In (/,,), (117) 

where: 

r{i+l/2)S.x p(j+l/2)Sk 

fij = qiPj= dx dk\xif{xmk)\\ (118) 

J{i-l/2)5x J{j-l/2)Sk 

In this way, the uncertainty relation ( |24] | becomes an inequality involving just one 
function fi{x,k) = defined on the phase space. This rearrangement is 

not so trivial when we extend it to the mixed states. For a density operator p we 
define the function: 
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f{x,k)^{x\p\k). (119) 

If the density operator represents a pure state, so that p = |V'^)(v^| we obtain the 
previous case f{x, k) = /i (jc, k) but for mixed states the function dl 19l l is not a simple 
product. Next, we define the two dimensional Fourier transform of f{x,k): 



f{X,pL) = ^ I dxe-'^' f dke'''t'fix,k) 



2n 

= (A| (^Ijx\x){x\^ p (^l^dk\k){k\^ III). 
= (A|p|m) = (mIp|A>*=/(AI,A)*, (120) 
where we used the following representation of the Fourier transform kernels: 

(121a) 



1 -iXx 



In 



^ e^'^^ik]^). (121b) 



27r 

The quantities in parentheses in this formula are the resolutions of the identity and 
were replaced by 1 . Thus, the function / and its Fourier transform / differ only in 
phase, 

I/I = |/| , (122) 

and we obtain: 

fj{x.k) ^Ijin.x)^ (123) 

For the function /i this is, of course, a trivial conclusion. Because of ( |123t the 
uncertainty relation for the Shannon entropies becomes a relation that involves only 
one entropy, defined in terms of a single function /. The price paid for this simpler 
form of the uncertainty relation is the additional condition ( 1122b that must be obeyed 
by the function /(x, k). 



4.4 Mutually unbiased bases 

In ( |3.1.3t we have introduced the notion of mutually unbiased bases (MUB) and we 
discussed the Maassen-Uffink lower bound for these bases. In this subsection we 
are going to present several other uncertainty relations of this type. To this end, we 
introduce in a D-dimensional Hilbert space ,y^o a system of M orthonormal bases 
B"' = {\bf),i e 1,... OT e 1,... ,M. Two bases B'" andB" are mutually unbiased 
bases if and only if |[60| for each pair of vectors: 
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\{bT\b'])\' ^ ^. (124) 

One may ask how many mutually unbiased bases can be found in J^d'^ In other 
words how does the number Mmax depends on D. There is no general answer to this 
question. It was found in |38| that if D is a prime number then M^ax = D+l. 

We have already given the uncertainty relations ( |79] l for two MUB's related by 
the discrete Fourier transformation. A straightforward generalization of these re- 
lations involves a sum over several MUB's. Let us denote by //("') the Shannon 
entropy for the ;7j-th base: 

=-Y,p'n In p1\ (125) 

(=1 



pT = \{bTm'- (126) 
Adding the uncertainty relations (|79] l for every pair of MUB's, we obtain |[3]: 

^ M 

^ //('")> _inZ). (127) 
When D is a prime number and we put M = D+l then the relation (I127l l reads: 

^'//M> (£±11 InD, (128) 



m=l 

but this bound is rather poor. Sanchez [53 1 found a better lower bound, 

> (D+l)ln^^. (129) 

m=l 

The reader can find extensions of the uncertainty relations of this type in ID and 
ll60l . Recently in 1621 another refinement of the inequality ( 1127b has been obtained, 

y >Mln— ^^^^^ . (130) 

h - M+D-l 

For M > 1 + ^/D this inequality is stronger than ( 1127b . 



4.5 Logarithmic Sobolev inequality 

In this subsection we find a direct relation between the standard Heisenberg un- 
certainty relation and the entropic uncertainty relation. This will be done with the 
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use of a different mathematical tool — the logarithmic Sobolev inequality and its 
inverse. We start with the inequalities for the continuous entropy (|84] i. The logarith- 
mic Sobolev inequality for the Shannon entropy proved in |[32l reads: 

5'-'' > i(l+ln27r)-^ln 

The important feature of this inequality is that we have only one function p{x). 
Therefore, we do not need conjugate variables (momentum) to obtain a lower bound 
of the Shannon entropy ( l84l i. On the other hand, the right hand side of ( 11311 ) depends 
on p{x), so it is a functional relation rather than an uncertainty relation. In order 
to obtain an uncertainty relation, we shall exploit the inverse logarithmic Sobolev 
inequality proved in II2TI : 

5^"^^ < ^(l+ln27r)+lnLcJ„ (132) 

where CTj is the standard deviation (|4|. Since this inequality involves only one distri- 
bution function, we can write it also for the probability density in momentum space 
p{k): 

5W<i(l+ln2;r)+ln((j,/L), (133) 

Evaluating the exponential function of the sum of the inequaUties (11321 ) and ( 11331 ). 
we obtain a refined version of the Heisenberg uncertainty relation lfT4ll27l : 

(yx(yk> iexp(^5*"'+5(*^)-l-ln7r^ > ^. (134) 

This uncertainty relation is stronger than the standard Heisenberg uncertainty rela- 
tion. Whenever the sum of the Shannon entropies exceeds its lower bound 1 + In tt, 
we obtain a stronger bound for (JxCTk than the standard 1/2. Note that the uncertainty 
relation ( |134| i holds for any pair of distributions. They do not have to be related by 
the Fourier transformation of the wave functions. 



dx 



p{x) 



dp{x) 
dx 



(131) 
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